Skip to content

Conversation

@andygrove
Copy link
Member

Which issue does this PR close?

Follows on from #2741

Rationale for this change

Remove temp fallback and use CometOperatorSerde framework instead

What changes are included in this PR?

  • Remove temp fallback and use CometOperatorSerde framework instead
  • Remove support for WindowsExec as a Comet sink because it causes panics
  • Update golden files

How are these changes tested?

case _: CollectLimitExec => true
case _: UnionExec => true
case _: TakeOrderedAndProjectExec => true
case _: WindowExec => true
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removing this line fixes #2737. I wish I could explain why, but I cannot.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WindowExec was added here because it was related to TakeOrderedProjectExec which was added here previuosly, but you are right, it is most likely the reason, why the operator doesn't fallback to Spark in clean way

@codecov-commenter
Copy link

codecov-commenter commented Nov 9, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 58.73%. Comparing base (f09f8af) to head (64035ff).
⚠️ Report is 685 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2748      +/-   ##
============================================
+ Coverage     56.12%   58.73%   +2.60%     
- Complexity      976     1465     +489     
============================================
  Files           119      163      +44     
  Lines         11743    13984    +2241     
  Branches       2251     2375     +124     
============================================
+ Hits           6591     8213    +1622     
- Misses         4012     4567     +555     
- Partials       1140     1204      +64     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@andygrove andygrove marked this pull request as ready for review November 10, 2025 00:04
@andygrove andygrove marked this pull request as draft November 10, 2025 00:30
@andygrove andygrove changed the title fix: Mark WindowsExec as incompatible fix: Mark WindowsExec as incompatible [WIP] Nov 10, 2025
@andygrove andygrove changed the title fix: Mark WindowsExec as incompatible [WIP] fix: Mark WindowsExec as incompatible Nov 10, 2025
@andygrove andygrove marked this pull request as ready for review November 10, 2025 18:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants